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(54) Implied interleaving, a family of systematic interleaves and deinterleavers 



(57) Apparatus that realizes a substantial advan- 
tage by employing implied interleaving to create a sys- 
tematic inter leaver, that can result in a superior block 
error rate compared to the current data interleaving 
techniques in which uncorrected error bursts are distrib- 
uted by the deinterleaver. The disclosed principles lead 
to a embodiments that essentially eliminate transmitter 
memory regardless of the interleaving approach 
employed. By way of example, block interleaving (regu- 
lar or random), convolutional interleaving (regular and 
random) and product interleaving approaches are 
described. In implied interleaving, all incoming data is 
treated as if it is pre-interleaved and transmitted directly 
to its destination without alteration to its sequence, and 
essentially without delay. Concurrently with the trans- 
mission of the data, the data is applied to apparatus that 
treats the data as if it had been interleaved in accord- 
ance with a selected interleaving approach and, in 
accordance with such treatment, redundant symbols 
are generated and inserted into the transmitted data 
stream. At the receiver, the incoming data is delayed, 
corrected, and the information symbols in the incoming 
data are delivered to the user, corrected as necessary, 
in the same order as the information symbols arrived at 
the receiver. 
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Description 

Background of the Invention 

5 This invention relates to systematic interleavers and deinterleavers that are used in conjunction with error correct- 

ing coders. 

Communication of signals invariably must deal with transmission of signals through noisy channels where errors 
are introduced. FIG. 1 presents the block diagram of a fairly sophisticated prior art arrangement for such an environ- 
ment, where data is first applied to encoder 1 00, the encoded data is passed on to interleaver 200, the interleaved data 
10 is modulated in block 300 and the modulated data is applied to the channel. The signal provided by the channel is 
demodulated in block 400, deinterleaved in block 500 and decoded in block 600. 

Interleaver 200 is interposed in the system in order to account for burst errors in the channel. Specifically, inter- 
leaver 200 disperses adjacent signal elements in time prior to modulation, that burst errors do not affect too many adja- 
cent signal elements of the original uninterleaved signal. Conversely, when considering the signal coming from the 
is channel, errors that are closely spaced in time are interspersed at the output and are, therefore, far apart from each 
other. The consequence of this dispersing is that decoder 600 is able to recover the data entered into encoder 100 by 
virtue of the error-correcting redundancy included in the signal which decoder 600 utilizes. 

As is well known, modulator 300 and demodulator 400 may be subsystems that themselves include robust coding 
and decoding. For example, modulator 300 may include a front end section that is a trellis encoder. Correspondingly, 
20 the tail-end of demodulator 400 would include a Viterbi decoder. 

Summary 

A substantial advantage is realized in accordance with the principles disclosed herein by employing implied inter- 
ns leaving. An implied interleaver is a systematic interleaver. which is one that does not alter the incoming data sequence, 
and as such may result in a superior block error rate, compared to the current data interleaving techniques in which 
uncorrected error bursts are distributed by the deinterleaver. 

While in other interleaving and encoding approaches the encoding apparatus requires memory and imposes delay 
upon some of the transmitted signal, implied interleaving essentially dispenses with all memory and corresponding 
30 delay in the transmitter-encoder By way of example, block interleaving, convolutional interleaving, random and product 
interleaving approaches are described. The only memory that is needed is the one which is normally provided for the 
speed-up in the data rate to create room for the insertion of redundant symbols in the transmitted data stream. Concur- 
rently with its transmission, the data is applied to apparatus that treats the data as rf it had been interleaved in accord- 
ance with a selected interleaving approach. In accordance with such treatment, redundant symbols are generated and 
35 inserted into the transmitted data stream. 

At the receiver, the incoming data is delayed, corrected, and the information symbols in the incoming data are deliv- 
ered to the user, corrected as necessary, in the same order as the information symbols arrived at the receiver. Since 
the data sequence is not changed at the receiver, the decoder can operate on the data directly inside the deinterleaving 
memory. The errors are therefore corrected in-place, without the need for multiple data storage at the decoder input and 
40 output stages. 

Brief Description of the Drawing 

FIG. 1 shows a prior art coder/decoder arrangement with an interleaver and a deinterleaver-interleaver interposed 
45 therebetween; 

FIG. 2 illustrates block interleaving; 

FIG. 3 presents a memory map arranged for block interleaving; 
FIG. 4 illustrates convolutional interleaving; 

FIG. 5 presents a memory map for a convolutional code where codewords are of length 1 1 and the interleaving 
so depth is 5; 

FIG. 6 presents a memory map for a convolutional code where codewords are of length 1 1 and the interleaving 
depth is 7; 

FIGS. 7-9 correspond to FIGS. 3. 5, and 6. with the redundant symbols shown; 
FIG. 10 is a block diagram of one realization of an encoder following the principles disclosed herein; 
55 FIGS. 1 1-12 are other embodiments of the principles disclosed herein; 

FIG. 13 is a block diagram of a receiver suitable for encoder arrangement of FIG. 10. and it is also a depiction of 
the most compact transmitter; 

FIG. 14 presents a memory map for product encoding; 

FIG. 15 is an encoder arrangement for the FIG. 14 product code; and 
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FIG. 16 illustrates random convolutional interleaving. 
Detailed Description 

5 Interleaving algorithms and techniques were introduced to the art of communication in order to increase the noise 

immunity of systems that are subject to burst errors. Interleaving algorithms define the relations among data sequences 
of different codeword blocks on the transmission channel, and interleaving techniques define the implementation meth- 
ods to achieve these relations. Examples of interleaving algorithms are block interleaving, and convolutional interleav- 
ing. Examples of interleaving techniques, are data interleaving and code interleaving. 

w In data interleaving, information is first applied to an encoder, and the encoder's output is interleaved. In code 
interleaving (a rarely used technique), the information is interleaved first and then applied to the encoding process. This 
technique is described by R. G. Gallager in "information Theory and Reliable Communication", John Wiley & Sons, 
1968, pp. 286 et seq (FIG. 2). Gallager presents an Interlaced interleaving in a block interleaved arrangement where 
the incoming information are gated to multiple encoders. The Interlaced Interleaving approach is an example of code 

rs interleaving where the information is interleaved first and then encoded, Gallager employs a plurality of encoders. In 
effect, he deinterleaves the information, routes the deinterleaved information to the encoders, and then re-interleaves 
the information and the redundant symbols. He has apparently not realized that data can be viewed a being pre-inter- 
leaved. 

An understanding of interleaving algorithms can be gained by looking at the movement of data symbols in the time 
20 domain, as shown for example in FIG. 2, or by viewing the process of storing data in a matrix in accordance with one 
procedure and retrieving it in accordance with another procedure, as shown for example in FIG. 3. Both FIGS. 2 and 3 
illustrate block interleaving. 

In block interleaving, a block of data is rearranged to insure that consecutive symbols in the block prior to interleav- 
ing are not adjacent in the block after the interleaving. A clear characteristic of block interleaving is that the interleaved 
-25 data can be separated into blocks of consecutive symbols which correspond to blocks of consecutive symbols in the 
uninterleaved data. The only difference between the two corresponding blocks is in the sequence of symbols in the 
blocks. 

For illustrative purposes, FIG. 2 depicts two blocks of data. 1 01 and 102, each having NxD symbols. More particu- 
larly, each block includes D groups (codewords) of N symbols each. Since block interleaving rearranges the sequence 

30 of symbols, it is clear that a delay must be introduced in order to allow later arriving symbols to appear earlier in the 
interleaved output. To a first degree of approximation, in block encoding, the interleaved data of each block can be 
obtained only after the entire block of data has arrived. This is depicted by blocks 103 and 104 in FIG. 2, which corre- 
spond to the interleaved data of blocks 101 and 102, respectively. The interleaving of data is accomplished by taking 
consecutive symbols of each codeword, and dispersing them at intervals of D symbols in blocks 1 03 and 1 04 (the value 

35 of D being the interleaving depth). Thus, the 1st symbol of the first codeword in block 101 (line 111) becomes the 1st 
symbol of codeword 1 03, the 2nd symbol of the first codeword of block 1 01 (line 1 1 2) is moved to be the (D+1 ) th symbol 
of codeword 103, the third symbol of the first codeword of block 101 (line 1 13) is moved to be the (2D+1) th symbol of 
codeword 103, etc. 

In the same interleaving procedure, but viewed another way, the first symbol of the 1st codeword in block 102 (line 
40 114) becomes the first symbol of codeword 104, the first symbol of the 2nd codeword in block 1 02 (line 1 15) is moved 
to be the 2nd symbol of codeword 1 04, etc. 

If the data of block 101 is written into successive cells of a storage element, then the above-described interleaving 
can be realized by simply reading data out in jumps of D cells. If the storage element is viewed as a matrix, as depicted 
in FIG. 3, and data is written into the matrix a column at a time, where each column contains a number of cells equal to 
45 the number of symbols in a codeword, then each codeword occupies a column (see shaded area in the first column) 
and the above-described interleaving is realized by reading data out of the matrix, a row at a time. 

As indicated above, the interleaving described in connection with FIGS. 2 and 3 is block interleaving, where one 
can identify a block of input data and a corresponding block of output data. The output block contains only the data of 
the input block. 

so In convolutional interleaving, no output block of contiguous data signals can be found that corresponds to an input 

block of data, in the sense of containing only the data of the input block. 

A convolutional interleaving arrangement is depicted in FIG. 4, where the codeword length. N, is 11 symbols and 

the interleaving depth, D. is 5. It may be said that input block 105 supplies data to an interleaved output symbol 

sequence 106 of length NxD. but it supplies only some of the symbols for sequence 106. and it also supplies data to a 
55 following symbol sequence. The latter data is illustrated by the 20 (short) up-arrows in block 105. Correspondingly, 

sequence 1 06 receives symbols from the block that is previous to block 1 05, and that data is illustrated by the 20 (short) 

down-arrows in sequence 106. 

FIG. 5 is a matrix representation of the FIG. 4 interleaving, and it contains 11 rows and 5 columns. Following the 

teachings of Aslanis et al in "A Selective Error Correction Proposal for ADSL", ANSI Contribution T1 E1 .4/93-023, March 
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8, 1 993, if the codewords A through E of FIG. 4 are written in columns as depicted in FIG. 5, then data that is read out 
from the matrix a row at a time yields the convolutional interleaving of FIG. 4. More specifically, for an arrangement 
where N=1 1 and D=5, if data is written a column at a time, with each successive codeword being generally staggered 
by 2 rows (codeword 0 starting at row 0, and each codeword i starting at row 2i), then a straight reading-out by rows 
5 results in an interleaved output. 

A number of attributes should be noted in connection with the storage of data in a matrix, and the teaching of 
Aslanis et al. 

1 ) Aslanis et al state that N and D must be co-prime in order for this arrangement to work; although they recognize 
to that when N and D are not co-prime dummy symbols can create a co-prime relationship. However, the data at the 

interleaver output is NOT uniformly distributed. One gets K*(N/D) of symbols with a spacing of D and then one gets 
a symbol with a spacing of D+1 (K is the largest common divisor). The total system delay is increased by D/K sym- 
bols. 

2) Different sets of N and D values will result in different staggering in rows and columns. Thus, for example, code- 
rs words that are adjacent in the input data stream may not be in adjacent columns of the matrix. This is illustrated in 

FIG. 6. where N=1 1 and D=7. 

3) Aslanis et al believed that both block interleaving and convolutional interleaving require an interleaving memory 
of fsKD symbols. 

4) In the convolutional interleaving described by Aslanis et al and the associated storing of data in the matrix, the 
20 first symbol in each codeword experiences no delay. The data is written and then read-out immediately thereafter. 

Other symbols, however, incur a delay that varies with the symbol position in the codeword. On the receiver side 
the deinterleaved data is again delayed by different amounts with the total delay being equal across all data sym- 
bols. 

25 Effectively zero uniform delay can be achieved by assuming that the data to be transmitted is actually the inter- 
leaved result of some other imagined data to which an interleaving algorithm had been applied. With such an assump- 
tion, any interleaving algorithm can be assumed to have been applied to this imagined data, with essentially no 
associated increase in the complexity of the encoder or decoder. Stated in other words, if the data comes already inter- 
leaved, the memories into which the data is inserted in accordance with the depictions of FIGS. 5 and 6 are not needed. 

30 With the available data already "interleaved", all that remains to be done is to encode the data and transmit it. This 
leads to the implied interleaving concept, with its systematic characteristic, tor all types of interleaving algorithms not 
just block interleaving. 

In applications where the encoding comprises merely the addition of a number of redundant, error correcting sym- 
bols/symbols, a rate conversion must be executed to provide the time slots in which the redundant symbols are kept, 

35 and that requires some minimal amount of memory. The redundant error correcting symbols are symbols that are asso- 
ciated with a group of consecutive signals in the uninterleaved data. This memory is normally needed at each encoder 
and distributed over the multiple encoders. By combining all distributed small buffers into a single one at the data input, 
additional reduction in total rate conversion memory is achieved where the combined memory can be as small as one 
of the small buffers at one of the encoder inputs. Effectively reducing the memory by another factor D. 

40 if the matrix arrangements of FIGS. 3, 5 and 6 were viewed the with 2 error correcting symbols added to each code- 
word, the result would be as presented in FIGS. 7, 8 and 9, respectively. It may be noted that, with the particular inter- 
leaving that was implied, the positions of the codewords in columns of the matrices are different from those in FIGS. 3, 
5 and 6. The cells containing numbers (1,2,3,4 and 5) designate the cells where the codewords start, and the cross- 
hatched cells are the cells that contain the error correcting symbols. To reiterate, however, when the data comes in 

45 already interleaved, the arrangements of FIGS. 7-9 as well as FIGS. 5-6 do not represent needed memory, but are 
shown merely to assist in understanding the invention. 
Compared with Aslanis et al: 

1) N and D can be of any ratio and the data can be uniformly distributed, based only on designer's choice; 
so 2) The staggering in rows and columns to different sets of N and D values and are the sole choice of the designer; 

3) Both block interleaving and convolutional interleaving require no transmit delay; 

4) All symbols incur a zero delay, regardless of their position in the code word; and 

5) Multiple channels with different encoders and interleaving depth can be interleaved in the same circuit. 

55 Moreover, there are multiple encoder architectures that can be employed within the scope of the principles disclosed 
herein. One can have an architecture that is similar to that of Gallager (with appropriate added controllers), one can 
have an architecture that includes a buffer at the common input, buffer in the data path and in the encoders, multiple 
buffers at the input to allow multiple channels, buffer at the output instead of at the input or an architecture where all 
memory needs are met with a single RAM and an ALU with an associated controller. 
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A data transmitting module in accordance with the principles disclosed herein is depicted in FIG. 10 with Reed 
Solomon encoding. Specifically, FIG. 10 includes a small FIFO buffer 220 whose output is transmitted to channel 10 via 
multiplexer 221. The output of buffer 220 is also applied to a router 222 which feeds a number of RS (Reed Solomon) 
encoders equal to the interleaving depth, D, of which encoders 223, 224, 225 are shown. The encoders develop error 

5 correction symbols and, at the appropriate times, those symbols are transmitted to channel 10 via router 226 and mul- 
tiplexer 221. Buffer 220 provides the buffer necessary for rate conversion. The amount of memory is dependent on the 
specifics of N and D, as well as on the nature of the assumed interleaving algorithm. Thus, for the block interleaving of 
FIG. 7, for example, while the last two rows of the matrix (the error correcting symbols) are applied to the communica- 
tion channel, all incoming data symbols must be buffered. While the 10 error correcting symbols of the FIG. 7 arrange- 

io ment are applied to channel 10 (and all form a single uninterrupted sequence when read out from the matrix), there are 
(10x55)/65 symbols that arrive which must be buffered. Hence buffer 220 requires ten symbols of storage. In the con- 
volutional interleaving of FIGS. 8 and 9, on the other hand, the longest sequence of error correcting symbols applied to 
channel 10 is 1 in FIG. 8 and 2 in FIG. 9. Hence, buffer 220 requires only a minimal number of storage symbols, a single 
symbol of storage or two, respectively. Viewed another way, the buffer needs to contain enough information so, that 

75 while symbols are inserted at one rate and extracted at a higher rate, the buffer will not fail to contain symbols when 
symbols needs to be extracted. This leads to the relationship that the buffer needs to be as large as N[(T</Tj)-1] raised 
to the next integer, where N is the largest block of extracted symbols between redundant symbols, and T 0 and Tj are 
the output and input rates, respectively. 

Elements 222 and 226 are obviously affected by the interleaving algorithm that is assumed to have been applied 

20 to the "interleaved" data. Multiplexer 221 needs to know when the data symbols are communicated from buffer 220 and 
when the error correcting symbols are communicated from combiner 226, and router 222 needs to know where to route 
the data symbols, in accordance with the assumed, or implied, interleaving. 

For example, if it is assumed that the incoming data has been block interleaved in accordance with FIG. 7, the sym- 
bol corresponding to the cell in the first row and the first column is designated to be the first symbol of the first codeword, 
-25 and accordingly, it is routed by element 222 to an RS encoder (e.g., encoder 223) that had been reset immediately prior 
to the arrival of that symbol: The next symbol, designated to be the first symbol of the second codeword, is routed by 
element 222 to a second RS encoder (e.g., encoder 224) that had been reset immediately prior to the arrival of that 
symbol; and the same treatment is applied to the remaining three symbols. According to FIG. 7, after channel 10 
receives 55 symbols from buffer 220 via multiplexer 221 (and at that time the same 55 symbols are applied to RS 

30 encoders 223-225 via router 222, the channel receives the next 10 symbols from the RS encoders via combiner 226 
and multiplexer 221 . It may be noted in passing that combiner 226 and multiplexer 221 can be implemented in a single 
combiner, but it is shown here as two elements to make the description clearer. 

In light of the above example, one can view the sequencing as being divided into two segments: a 55 symbol "data 
symbols" segment and a 10 symbol "error correcting symbols" segment. During the data symbols segment router 222 

35 sequentially cycles through 5 RS encoders, and during the first 5 symbols of the data segment each RS encoder to 
which data is routed is reset prior to the application of the data symbol. During the data symbols segment, multiplexer 
221 is set to pass the data out of buffer 220 to channel 10, and the actions of combiner 226 are irrelevant. During the 
error correction symbols segment, no data is entered into the encoders by router 222, multiplexer 221 is set to pass the 
output signal of combiner 226 to channel 10, and combiner 226 cycles twice through the five RS encoders and delivers 

40 their error encoding symbols to channel 10. Data that arrives at that time is stored in buffer 220. 

The principle is the same for data that is assumed to have been interleaved in accordance with the illustration in 
FIG. 8, but the specific sequencing is different. The table below illustrates the actions in connection with the first 1 7 sym- 
bols for the arrangement corresponding to FIG. 8. 

45 



50 



55 
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It may be noted that the cell where encoder 2 is reset is determined, for example, by designer's choice, by advanc- 
ing 13 cells (the length of the codeword with the 2 error correcting symbols) from the point where encoder 1 is reset. 
The same applies for the resetting of all other encoders. 

35 The actual control is exercised by controller block 250. The specific circuitry within block 250 (counters, shift regis- 
ters and some combinatorial logic) is not presented here because it is perfectly conventional and because it will depend 
on the particular interleaving schema that is implied, or presumed. The important thing to note, however, is that the FIG. 
10 arrangement is general enough to handle block interleaving, convolutions interleaving (as disclosed above) and 
product encoding that could combine, for example, block interleaved and convolutionaily interleaved data (as disclosed 

40 below). 

The following presents an arrangement of a implied convolutions interleaving of codewords of 120-symbol length 
and an interleaving depth of 30. 
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The signals of the first column are routed by element 222 to a first encoder (223), the signals of the second columns 
are routed to a second encoder (224). and so on. Elements C m _ 29 3 through C m . 29 0 are the redundancy symbols. 
Viewed another way, each set of D consecutive symbols is distributed among D encoders, and every (D+1) 1h symbol is 
applied to the same encoder. 

FIG. 1 1 presents a somewhat different encoder architecture, where the memory of buffer 220 is embedded in the 
encoders and the data as well as the redundant symbols are provided by the encoders. It is shown for the convolutional 
arrangement presented above with 120-symbol codewords and an interleaving depth of 30. FIG. 12 presents still 
another architecture, where a separate buffer is used for the data path and the encoding path, allowing more complex 
encoding structure. 
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At the receiver end, the arriving data can be utilized immediately, if desired, because it arrives in the same order 
that it had been generated by whatever equipment created the data that had been applied to buffer 220 in the transmit- 
ter. If the error correction codes are to be utilized, then the data must first be evaluated whether a transmission error 
occurred. Conceptually, the decoding can be done essentially in the very same manner as the error correcting symbols 

s were generated in the transmitter of FIGS. 10-12. That is, the data can be routed to a collection of RS decoders, error 
correcting symbols can be generated and then used to evaluate the need to correct symbols that arrive from the trans- 
mitter. Thereafter, additional processing must be carried out to correct errors, if any, and finally, the corrected data can 
be delivered to its ultimate user. That means, of course, that the arriving data must be delayed (and maintained) prior 
to its delivery to the ultimate user until the error correction processing is accomplished; ergo, a memory is needed. More 

w specifically, the amount of memory needed is equal to that which is sufficient to store the entire codeword, and to store 
newly arriving information while the codeword is evaluated and corrected. 

In the arrangement of FIG. 7, for example, the implied interleaving is block interleaving and the evaluation and cor- 
rection cannot start until all data is in (at theend of the 1 1th row in FIG. 7). The evaluation of all 5 codewords starts in 
the 1 2th row, and all 5 codewords must, then, be evaluated concurrently. If the equipment that can evaluate and correct 

is the 5 codewords takes, for example, 6 symbols periods per codeword, or 30 symbol periods, then the total memory 
required is 65 symbols to store the 5 codewords and 30 symbols to store the incoming data during the correction phase; 
for a total of 95 symbols, or D(N+L), where L is the number of symbols necessary to correct a codeword. (As an aside, 
the element that carries out the calculations necessary to correct transmission errors is not limited to operating at the 
symbol rate of the incoming data and, typically, such an element, e.g. a microprocessor, can operate at speeds that are 

20 far higher than the symbol rate of the data.) 

In the arrangement of FIG. 8, on the other hand, the codewords do not begin and end at the same time and, there- 
fore, the codeword evaluations and corrections also do not need to occur concurrently. Specifically, in the FIG. 8 
arrangement there are 1 3 cells from the end of one codeword to the end of the next codeword, and 5 cells from the time 
the last redundant symbol of a particular codeword arrives (e.g., the codeword in column 1 of the FIG. 8 matrix) and the 
. 25 first symbol of the next incarnation of that codeword arrives. Since it takes only 6 symbol periods to correct a codeword 
(with equipment used in the above example), it follows that one symbol of additional memory is required. Hence, the 
total memory required in the receiver for the FIG. 8 arrangement is 66 symbols. On the other hand, with a faster proc- 
essor that requires only 5 symbol periods to correct a codeword, only 65 symbols of memory would be required - which 
is the minimum memory necessary. One can think of the memory requirement as ND, plus L-D, with the minimum being 

30 ND. 

FIG. 1 3 presents a block diagram of still another embodiment that is adapted to the principles of this invention. Just 
as with the arrangement of FIG. 1 1 , it can serve as an encoder (within a transmitter), or as a decoder (within a receiver). 
It includes a memory 310, a processor 320 coupled to memory 310 and a controller 330 coupled to memory 310 and 
processor 320. As depicted, memory 310 includes a number of data ports (input, output to user and output to processor 

35 320) but in actuality, a single IAD port is time shared. When acting as a receiver, processor 320 reads data from memory 
310 and analyzes that data. If correction of data symbols is called for. processor 320 writes data into memory 310. 

Processor 320 carries out the processing necessary for detecting errors and for correcting errors. Some memory 
is needed to store temporary results of the error detection processes, and that memory may be included within control- 
ler 330 or be part of memory 310. A program store memory will, of course, provide the necessary storage area. That 

40 memory also holds the programs that control processor 320. 

The error correction processing method that processor 320 carries out is not described here because it may be per- 
fectly conventional and forms no part of this invention. Whatever coding schema is selected (be it Reed -Solomon, or 
other coding), the corresponding decoding must be applied by processor 320. What is unique in both the transmitter 
and the receiver arrangements is the utter flexibility to handle whatever implied interleaving is selected, and the simplic- 

45 ity of the attendant controls. Thus, for example, for the interleaving arrangement shown in FIG. 8 and the FIG. 13 
arrangement used as a receiver, when the controller focus is on cell 1 (first row, first column) the following activities take 
place: 

A1. memory 310 outputs the symbol stored for codeword 1 in cell 1 (which had already been corrected, if neces- 
so sary) and delivers it to the user; 

A2. the error detection temporary store for codeword 1 (in controller 330) is reset; 

A3, the symbol arriving at the receiver is declared to be the first symbol of the next codeword 1 and is stored in cell 

1; 

A4. the error detection information in the temporary store for codeword 1 is updated with the information stored in 
55 cell 1 ; and 

A5. the error correction processing for codeword 2 is initiated. 

When the controller focus is on cell 2, the following activities take place: 
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B1 . memory 310 outputs the symbol stored for codeword 3 in cell 2 and delivers it to the user; 
B2. the symbol arriving at the receiver is declared to be the next symbol of codeword 3 and it is stored in cell 2; 
B3. the error detection information in the temporary store for codeword 3 is updated with the information stored in 
cell 2; and 

5 B4. the error correction processing for codeword 2 is continued. 

By the time focus rests on cell 1 3, the error correction processing of codeword 2 is completed, allowing cell 1 4 to output 
the correct first symbol of codeword 2; whereupon process steps A1 through A5, above, can be executed. 

To demonstrate the flexibility of the arrangement disclosed herein, an extension to product encoding is presented. 

10 By "product" what is meant is that the implied interleaving can be viewed to be two dimensional, as illustrated, for exam- 
ple, in FIG. 14 which includes an implied convolutional interleaving arrangement in accord with FIG. 8 (column-wise), 
with an implied block interleaving row-wise. Since those error correcting symbols follow the data as it arrived (where 
cells are filled a row at a time), the modification to the transmitter is merely one additional encoder in parallel with the 
encoder bank illustrated, for example, in FIG. 10. Specifically, as shown in FIG. 15, the transmitter includes an addi- 

15 tional encoder 125 whose output is delivered to channel 10 under control of multiplexer 221. The FIG. 15 extension to 
the FIG. 10 arrangement is merely illustrative, of course. The other architectures, such as that of FIG. 13, are similarly 
extendible. 

At the receiver, when focus is on the row error correcting symbol, the information is available to perform whatever 
procedure is necessary within processor 320. The erroneous syrrtbol(s) in the row can then be corrected, or information 

20 about those symbols can be stored and taken into account when the codeword error correction process is executed. 
For example, with a single parity in each row, a single error in the row can be identified. That information can be com- 
municated to each of the codeword correction procedures, and that information can simplify those procedures. For 
example, knowledge that an error exists in row 4 of FIG. 8 corresponds to knowledge that an error may exist in symbol 
4 of codeword 1 , in symbol 12 of codeword 3 (the first redundant symbol in codeword 3), in symbol 7 of codeword 5, in 

25 symbol 2 of codeword 2, or in symbol 1 0 of codeword 4. 

The above discussion regarding convolutional interleaving depicted the conventional condition of regular convolu- 
tional interleaving where every (D+1) tb symbol belongs to a particular codeword. That is not a requirement, however. 
Indeed, the encoder/decoder of, for example, FIG. 1 3 can handle a random arrangement that does not follow the above 
notion. FIG. 16 illustrates such an implied convolutional interleaving where every (D+1) th symbols does not necessarily 

30 belong to a particular codeword. In contradistinction to regular convolutional interleaving, this may be considered 
random convolutional interleaving. Even a higher level of "randomness" is acceptable in, for example, abandoning the 
notion of consecutive symbols are routed to different encoders. That, in fact, is not a requirement, and one can easily 
devise arrangements where all, or some, of the encoders have a pair of consecutive symbols routed to them. The max- 
imum number of consecutive symbols is, of course, the number of symbols in a codeword, and that, obviously, is the 

35 limit (yielding a non-interleaved arrangement). 

Claims 

1. An encoder including a memory (310), and processing means (320) coupled to the memory including means (330) 
40 for writing incoming symbols into the memory, means (330) for reading symbols out of the memory at rate higher 
than the rate of writing into the memory and applying the read symbols tp a channel, means (330) for implementing 
D encoders (D being an integer) in cooperation with the processing means and the memory by employing the read 
symbols in calculations aimed at developing redundant symbols, where each set of D consecutive symbols are dis- 
tributed to different ones of the implemented D encoders, and means (330) for applying the redundant symbols to 
45 the channel, 

characterized in that 

the calculations for the D encoders are reset in accordance with a selected implied convolutional interleaving 
schema. 

so 2. An encoder according to claim 1 where, under control of the processing means, in addition to each set of D con- 
secutive symbols being distributed to different ones of the implemented D encoders, each (D+1) th symbol is 
employed in the calculations of a particular encoder. 

3. An encoder according to claim 1 where, under control of the processing means, in addition to each set of D con- 
55 secutive symbols being distributed to different ones of the implemented D encoders, at least one set that contains 

each (D+1) th symbol is employed in the calculations of more than one encoder. 

4. An encoder according to claim 1 where incoming symbols are written into a data buffering region of the memory, 
symbols are read out of the data buffering region, and implementation of the D encoders involves storage of calcu- 
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lation results, which results are stored in another region of the memory. 

5. The encoder of claim 1 where the reading out of symbols out of the memory is in the same order as symbols written 
into the memory. 

5 

6. The encoder of claim 1 further comprising means for block encoding said incoming signals. 

7. The encoder of claim 6 wherein said block interleaving and said convolutions interleaving form a product encoding 
arrangement 

10 

8. An implied interleaving encoder responsive to a stream of incoming data symbols that is assumed to comprise 
codewords having N symbols which include redundant symbols and which are interleaved in a convolutional inter- 
leaving pattern to an interleaving depth D, for developing the redundant symbols for each of the codewords and 
inserting them in the stream of incoming data symbols in accordance with the interleaving pattern, including a plu- 

15 rality of D encoders (223). each of which develops a set of at least one redundant symbol corresponding to a 
sequence of symbols that define a data portion of a codeword, a first router (222), responsive to incoming data for 
delivering successive symbols to different ones of the D encoders in cyclic manner, and a combiner (226, 221), 
responsive to the redundant symbols developed by the D encoders and to output data of the first memory, for apply- 
ing information arriving at the combiner to a channel, characterized in that 

20 each of the D encoders is arranged handle codewords that are offset from the codewords handled by the 

other encoders by at least two symbols. 

9. A method for encoding and interleaving an applied sequence of input signals arriving at regular intervals, the 
sequence having a given order, to develop an interleaved output signal comprising the input signals in a sequence 

-25 having the same given order, the method comprising the steps of: 

routing the input signals to a plurality of encoders; 

in response to the input signals routed to the encoders, the encoders developing a selected number of redun- 
dant signals and outputting the redundant signals, where the inserting of redundant signals by any one of the 
30 encoders is staggered in time relative to any other one of the encoders by more than one of said intervals; and 

routing the output signals of the encoders to an output port. 

10. A decoder responsive to an incoming stream of data that includes codeword that are N symbols long which are 
interleaved to a depth D. where each codeword includes information symbols and redundant symbols, comprising: 

35 

a processor (320) for correcting errors found in said codewords; 

a storage device (310), coupled to said incoming stream of data and to said processor, having memory allo- 
cated for storing D(L+N) symbols, where L is the number of symbols arriving at the decoder during the time 
needed by the processor to correct errors found in one codeword; and 
40 a controller (330) for controlling said processor as well as input and output of data to and from the memory; 

where 

errors to be corrected are corrected by the processor by overwriting corrupted symbols with corrected 
symbols, and 

symbols of the incoming data are stored in the memory and the information symbols are delivered to a 
4 $ user port, from the memory, corrected as necessary, in the same order that the data arrived. 

1 1 . The decoder of claim 10 where the interleaving of the incoming stream of data is convolutional interleaving. 

12. The decoder of claim 11 and the memory contains at most ND symbols of memory devoted to storing incoming 
so data. 
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